Contextual augmented reality devices collaboration

ABSTRACT

A first display device determines a first device configuration of the first display device and a first context of a first AR application operating on the first display device. The first display device connects to a second display device and determines a second device configuration of the second display device and a second context of a second AR application operating on the second display device. The first display device generates a first collaboration configuration for the display device and a second collaboration configuration for the second display device. The first and second collaborations are based on the first device configuration, the first context, the second device configuration, and the second context. The second display device modifies an operation of the second AR application based on the second collaboration configuration. The first display device modifies an operation of the first AR application based on the first collaboration configuration.

TECHNICAL FIELD

The subject matter disclosed herein generally relates to an augmentedreality device. Specifically, the present disclosure addresses systemsand methods for delivery of context-based content among augmentedreality systems.

BACKGROUND

An augmented reality (AR) device can be used to generate and displaydata in addition to an image captured with the AR device. For example,AR provides a live, direct, or indirect view of a physical, real-worldenvironment whose elements are augmented by computer-generated sensoryinput such as sound, video, graphics or Global Positioning System (GPS)data. With the help of advanced AR technology (e.g., adding computervision and object recognition) the information about the surroundingreal world of the user becomes interactive. Device-generated (e.g.,artificial) information about the environment and its objects can beoverlaid on the real world.

When multiple AR devices are interconnected and used by multiple users,the content generated in one AR device may be replicated in other ARdevices regardless of the unique configurations of each AR devices. Forexample, the rendering of a virtual content or the process of aparticular task may be redundantly performed in each AR device causinginefficiencies in the network of connected AR devices.

BRIEF DESCRIPTION OF THE DRAWINGS

Some embodiments are illustrated by way of example and not limitation inthe figures of the accompanying drawings.

FIG. 1 is a block diagram illustrating an example of a network suitablefor an augmented reality (AR) collaboration system, according to someexample embodiments.

FIG. 2 is a block diagram illustrating an example embodiment of an ARdevice.

FIG. 3 is a block diagram illustrating an example of a collaborationbetween two AR devices.

FIG. 4 is a block diagram illustrating an example embodiment of an ARcontext collaboration application.

FIG. 5 is a block diagram illustrating an example embodiment of acurrent device configuration module.

FIG. 6 is a block diagram illustrating an example embodiment of aconnected device configuration module.

FIG. 7 is a block diagram illustrating an example embodiment of acollaboration module.

FIG. 8 is an interaction diagram illustrating interactions between twoAR devices, according to an example embodiment.

FIG. 9 is a flow diagram illustrating a method for contextualcollaboration between augmented reality devices.

FIG. 10 is a flow diagram illustrating a method for generatingcollaboration configurations for connected augmented reality devices.

FIG. 11 is a block diagram illustrating components of a machine,according to some example embodiments, able to read instructions from amachine-readable medium and perform any one or more of the methodologiesdiscussed herein.

DETAILED DESCRIPTION

Example methods and systems are directed to contextual collaborationbetween connected AR devices. Examples merely typify possiblevariations. Unless explicitly stated otherwise, components and functionsare optional and may be combined or subdivided, and operations may varyin sequence or be combined or subdivided. In the following description,for purposes of explanation, numerous specific details are set forth toprovide a thorough understanding of example embodiments. It will beevident to one skilled in the art, however, that the present subjectmatter may be practiced without these specific details.

AR refers to a technology that allows a user of a display device to viewdirectly (e.g., through a transparent lens) or indirectly (e.g., on ascreen of a smartphone) a physical, real-world environment whoseelements are augmented with virtual content (e.g., computer-generatedsensory input such as sound, video, graphics). The information about thereal-world environment becomes interactive and digitally manipulable.Furthermore, the information about the environment and its objects isoverlaid on the real world. This information can be virtual or real,(e.g. seeing other real sensed or measured information such asnon-visible radio signals overlaid in exact alignment with where theyactually are in space).

When multiple AR devices are interconnected and used by multiple users,content and operations generated in one connected AR device may beprovided or transferred to another connected AR device based on thecapabilities and capacities of the connected AR devices (e.g., hardwareand software configurations and availabilities), the profile of theusers (e.g., authorization level, user profile), the tasks beingperformed at the connected AR devices, and the physical environment ofthe connected devices among others. In an interconnected environment,connected AR devices can serve one user or a task collaboratively. Forexample, a connected AR device can adjust a configuration of itshardware and software to improve the productivity and use the resourcesmore efficiently by accessing the capabilities, capacities, and contextof the other connected devices, and allocating operations andfunctionalities based on the capabilities, capacities, and context ofthe other connected devices.

In one example, a user wearing an AR device (e.g., eyewear) gets into acar. The car includes an AR application that allows drivers to viewvirtual content displayed on a windshield of the car. The display systemis referred to as a head's up display (HUD) system. The HUD of the cartakes over to provide better display and more powerful interfaces, whileputting the AR device to hibernation to save power and reduceinterference.

In another example, several users are working together on one project,with a predefined standardized workflow (e.g., process or tasks ofusers). Their individual AR devices are tuned to generate contents orinterface with operations based on each user's task and procedure in thewhole workflow, and their individual progresses. Access control ofinformation is available based on each user's task or operation.Therefore, a portion of a task may be assigned to a first user of afirst AR device with specific hardware while another portion of the taskmay be assigned to a second user of a second AR device with specifichardware.

In one example embodiment, an AR device includes a display, sensors, anAR application, and an AR context collaboration application implementedin one or more processors. The display includes (transparent) lensesthat are disposed in front of the user's eyes to display AR content(e.g., virtual objects). The AR application renders the AR content fordisplay in the transparent display of the AR device. The sensors mayinclude a first set of sensors connected to the user of the AR device togenerate user-based sensor data related to a user of the AR device, anda second set of sensors inside the AR device to generate ambient-basedsensor data related to the AR device.

The first set of sensors measures data related to the user. For example,the first set of sensors is a biometric sensor that identifies andauthenticates the user. The biometric sensor may include, for example,an ocular camera attached to the transparent display and directedtowards the eyes of the user. In other examples, the first set ofsensors measures at least one of a heart rate, a blood pressure, brainactivity, and biometric data related to the user to generate theuser-based sensor data using for example, a heart rate sensor, a sweatsensor, and the biometric sensor. In another example, the biometricsensor includes electroencephalogram (EEG)/electrocardiogram (ECG)sensors disposed inside a perimeter of the helmet so that the EEG/ECGsensors connect to the forehead of the user when the helmet is worn. Thebiometric sensor generates biometric data based on, for example, theblood vessel pattern in the retina of an eye of the user, the structurepattern of the iris of an eye of the user, the brain wave pattern of theuser, or a combination thereof. The processor authenticates the userbased on the biometric data of the user of the HMD.

The second set of sensors measures at least one of a geographic locationof the HMD, an orientation and position of the HMD, an ambient pressure,an ambient humidity level, and an ambient light level to generate theambient-based sensor data. Examples of the second set of sensors includea camera, GPS sensor, an Inertial Measurement Unit (IMU), a locationsensor, an audio sensor, a barometer, a humidity sensor, and an ambientlight sensor.

The AR context collaboration application determines capabilities andcapacities of a current AR device, a task associated with the current ARdevice, a user-based context based on the user-based sensor data, and anambient-based context based on the ambient-based sensor data. Theuser-based context identifies the user of the HMD (e.g., user is John,employee 123, senior technician), a state of mind of the user (e.g.,John is distracted), and a physical state of the user (e.g., John issweating and breathing heavily while staring at machine M). Theambient-based context identifies data related to a state of the HMD. Forexample, the ambient-based context identifies ambient data related tothe location of the HMD. For example, the ambient data may identify ageographic location (e.g., HMD located at factory plant P), an elevation(e.g., HMD is located on the 3^(rd) floor of the factory plant P),ambient pressure (e.g., atmospheric pressure in a room where the HMD islocated), ambient humidity level (e.g., HMD is located in a room withhumidity level of 60%), ambient light level (e.g., ambient brightness of200 lumen detected by the HMD), or ambient noise level (e.g., noiselevel of 90 db detected by the HMD).

The AR context collaboration application generates AR collaborationconfigurations for each connected AR device based on the AR devicescapabilities and capacities, configurations, user-based context and theambient-based context. For example, a first AR device may be put inhibernation mode while a second AR device takes over an operation of thefirst AR device because the second AR device includes a higherresolution display than the first AR device.

In one example embodiment, a first display device determines a firstconfiguration of the first display device and a first context of a firstAR application operating on the first display device. The first displaydevice connects to a second display device and determines a secondconfiguration of the second display device and a second context of asecond AR application operating on the second display device. The firstdisplay device generates a first collaboration configuration for thedisplay device and a second collaboration configuration for the seconddisplay device. The first and second collaborations are based on thefirst configuration, the first context, the second configuration, andthe second context. The second display device modifies an operation ofthe second AR application based on the second collaborationconfiguration. The first display device modifies an operation of thefirst AR application in the display device based on the firstcollaboration configuration.

In another example embodiment, each AR device includes an AR applicationthat identifies an object in an image captured with a camera of arespective AR device, retrieves a three-dimensional model of a virtualobject from the AR content based on the identified object, and rendersthe three-dimensional model of the virtual object in a display of acorresponding AR device. The virtual object is perceived as an overlayon the real world object.

The display of the AR device may be retracted inside a head mounteddevice (e.g., helmet) and extended outside the helmet to allow a user toview the display. The position of the display surface may be adjustedbased on an eye level of the user. The display surface includes adisplay lens capable of displaying AR content. The helmet may include acomputing device such as a hardware processor with an AR applicationthat allows the user wearing the helmet to experience information, suchas in the form of a virtual object such as a three-dimensional (3D)virtual object, overlaid on an image or a view of a physical object(e.g., a gauge) captured with a camera in the helmet. The helmet mayinclude optical sensors. The physical object may include a visualreference (e.g., a recognized image, pattern, or object, or unknownobjects) that the AR application can identify using predefined objectsor machine vision. A visualization of the additional information (alsoreferred to as AR content), such as the 3D virtual object overlaid orengaged with a view or an image of the physical object, is generated inthe display lens of the helmet.

The display lens may be transparent to allow the user see through thedisplay lens. The display lens may be part of a visor or face shield ofthe helmet or may operate independently from the visor of the helmet.The 3D virtual object may be selected based on the recognized visualreference or captured image of the physical object. A rendering of thevisualization of the 3D virtual object may be based on a position of thedisplay relative to the visual reference. Other AR applications allowthe user to experience visualization of the additional informationoverlaid on top of a view or an image of any object in the real physicalworld. The virtual object may include a 3D virtual object and/or atwo-dimensional (2D) virtual object. For example, the 3D virtual objectmay include a 3D view of an engine part or an animation. The 2D virtualobject may include a 2D view of a dialog box, menu, or writteninformation such as statistics information for properties or physicalcharacteristics of the corresponding physical object (e.g., temperature,mass, velocity, tension, stress). The AR content (e.g., image of thevirtual object, virtual menu) may be rendered at the helmet or at aserver in communication with the helmet. In one example embodiment, theuser of the helmet may navigate the AR content using audio and visualinputs captured at the helmet or other inputs from other devices, suchas a wearable device. For example, the display lenses may extract orretract based on a voice command of the user, a gesture of the user, ora position of a watch in communication with the helmet.

In another example embodiment, a non-transitory machine-readable storagedevice may store a set of instructions that, when executed by at leastone processor, causes the at least one processor to perform the methodoperations discussed within the present disclosure.

FIG. 1 is a network diagram illustrating a network environment 100suitable for operating an AR collaboration system, according to someexample embodiments. The network environment 100 includes an AR device A102, an AR device B 104, an AR device C 106, and a server 110,communicatively coupled to each other via a network 108. AR device A 102is connected (e.g., wired or wirelessly) to AR device B 104 within aphysical environment 112 (e.g., a room or a building). The AR devices102, 104, 106 and the server 110 may each be implemented in a computersystem, in whole or in part, as described below with respect to FIG. 11.The server 110 may be part of a network-based system. For example, thenetwork-based system may be or include a cloud-based server system thatprovides collaboration configurations to the AR devices 102, 104, 106.In another example, the server 110 provides AR content (e.g., augmentedinformation including 3D models of virtual objects related to physicalobjects in images captured by the AR devices) to the AR devices 102,104, 106.

AR devices A 102, 104, 106, each include a display device for acorresponding user to view the AR content related to captured images ofphysical objects (not shown) in a real world physical environment. Inone example embodiment, the AR device 102 includes a computing devicewith a camera and a display (e.g., smart glasses, smart helmet, smartvisor, smart face shield, smart contact lenses). The computing devicemay be removably mounted to the head of the user 114. In one example,the display may be a screen that displays what is captured with a cameraof the AR device 102. In another example, the display of the AR device102 may be a transparent display, such as in the visor or face shield ofa helmet, or a display lens distinct from the visor or face shield ofthe helmet.

The user 114 may be a user of an AR application in the AR device A 102.The user 114 may be a human user (e.g., a human being), a machine user(e.g., a computer configured by a software program to interact with theAR device A 102), or any suitable combination thereof (e.g., a humanassisted by a machine or a machine supervised by a human). The user 114is not part of the network environment 100, but is associated with theAR device A 102.

In one example embodiment, the AR application in the AR device A 102determines the AR content to be rendered and displayed in thetransparent lenses of the AR device A 102 based on capabilities andcapacities of the AR device, user-context and ambient-context, and usertasks. The capabilities and capacities may be determined from theconfiguration of the AR device A 102. For example, the configuration mayspecify specifications related to the AR device A 102 such as the typeof display, a resolution of the display, a type of processor, or amemory size. The configuration further identifies processing usage,memory usage, and sensor capabilities. The user context identifies aprofile of the user (e.g., authorized user is part of the tech supportteam of an organization), and biometric data related to the user (e.g.,user is sweating and his/her heart rate is beating fast). The ambientcontext identifies ambient data based on a local environment of the ARdevice A 102. For example, the ambient data identifies that the physicalenvironment 112 (e.g., room) where the user 114 is located is hot andhumid compared to a predefined temperature and humidity range. The usertasks identify a task of the user 114 (e.g., user is a technician fixinga machine in the physical environment 112).

In one example embodiment, the user context is based on sensor datarelated to the user 114 and includes measurements of a heart rate, ablood pressure, brain activity, and biometric data related to the user.The ambient context is based on sensor data related to the AR device A102 and includes a geographic location of the AR device A 102, anorientation and position of the AR device A 102, an ambient pressure, anambient humidity level, an ambient light level, and an ambient noiselevel detected by sensors in the AR device A 102. The sensor datarelated to the user 114 may also be referred to as user-based sensordata. The sensor data related to the AR device A 102 may be alsoreferred to as ambient-based sensor data.

The AR device A 102 detects that the AR device B 104 is located in thesame physical environment. The AR device A 102 connects to the AR deviceB 104 to exchange configuration information. An AR context collaborationapplication in both AR devices 102, 104 processes the configurationinformation, and determines which operation, function, hardwarecomponent (e.g., cameras) to operate on which AR device. For example,the AR context collaboration application determines that the AR device A102 includes a higher resolution camera than the camera of AR device B104. The AR context collaboration application assigns the imagecapturing process to the AR device A 102. In another example, the ARcontext collaboration application determines that the AR device A 102includes a higher resolution display than the display of the AR device B104. The AR context collaboration application assigns the displayprocess to the AR device A 102.

The AR context collaboration operates on connected AR devices within asame physical environment 112. For example, the AR device C 106 is notconnected to either the AR device A 102 or AR device B 104 because ARdevice C 106 is not in the same physical environment 112 as AR device A102 and AR device B 104.

In another example, the contextual configuration of the AR device A 102includes using a microphone in the AR device A 102 when the user 114 ison the first floor of a building. The AR context collaborationapplication determines that both AR devices 102, 104 are located on thefirst floor and that the task of each AR device requires listening toambient noise from the first floor. When the user 114 moves to thesecond floor of the building, the contextual configuration of the ARdevice A 102 changes to include using a microphone of the AR device B104.

In another example embodiment, each AR device 102, 104 provides thecorresponding user 114, 116 with an AR experience triggered byidentified objects in the physical environment 112. The physicalenvironment 112 may include identifiable objects such as a 2D physicalobject (e.g., a picture), a 3D physical object (e.g., a factorymachine), a location (e.g., at the bottom floor of a factory), or anyreferences (e.g., perceived corners of walls or furniture) in the realworld physical environment 112. The AR application may include computervision recognition to determine corners, objects, lines, and letters.The user 102 may point a camera of the AR device to capture an image ofthe physical objects in the physical environment 112.

In one example embodiment, physical objects in the environment 112 aretracked and recognized locally in the AR devices 102, 104 using a localcontext recognition dataset or any other previously stored dataset ofthe AR application of the AR devices 102, 104. The local contextrecognition dataset module may include a library of virtual objectsassociated with real-world physical objects or references. In oneexample, the AR devices 102, 104 identify feature points in an image ofthe physical objects to determine different planes (e.g., edges,corners, surface, dial, letters). The AR devices 102, 104 also identifytracking data related to the physical objects (e.g., GPS location of theAR devices 102, 104, orientation, distances to objects). If the capturedimage is not recognized locally at the AR devices 102, 104, the ARdevices 102, 104 can download additional information (e.g., 3D model orother augmented data) corresponding to the captured image, from adatabase of the server 110 over the network 108.

Any of the machines, databases, or devices shown in FIG. 1 may beimplemented in a general-purpose computer modified (e.g., configured orprogrammed) by software to be a special-purpose computer to perform oneor more of the functions described herein for that machine, database, ordevice. For example, a computer system able to implement any one or moreof the methodologies described herein is discussed below with respect toFIGS. 9-10. As used herein, a “database” is a data storage resource andmay store data structured as a text file, a table, a spreadsheet, arelational database (e.g., an object-relational database), a triplestore, a hierarchical data store, or any suitable combination thereof.Moreover, any two or more of the machines, databases, or devicesillustrated in FIG. 1 may be combined into a single machine, and thefunctions described herein for any single machine, database, or devicemay be subdivided among multiple machines, databases, or devices.

The network 108 may be any network that enables communication between oramong machines (e.g., server 110), databases, and devices (e.g., HMD101). Accordingly, the network 108 may be a wired network, a wirelessnetwork (e.g., a mobile or cellular network), or any suitablecombination thereof. The network 108 may include one or more portionsthat constitute a private network, a public network (e.g., theInternet), or any suitable combination thereof.

FIG. 2 is a block diagram illustrating modules (e.g., components) of anAR device 202, according to some example embodiments. The AR device 202may be a display device that includes sensors 216, a display 206, astorage device 208, and a processor 210. The AR device 202 includes andmay not be limited to a head-mounted device (e.g., smart helmet, visor,headband, hat, glasses).

The sensors 216 measure internal tracking data of the AR device 202 todetermine a position and an orientation of the AR device 202. Theposition and the orientation of the AR device 202 may be used toidentify real world objects in a field of view of the AR device 202. Forexample, a virtual object may be rendered and displayed in the display206 when the sensors 216 indicate that the AR device 202 is orientedtowards a real world object (e.g., when a user of the AR device 202looks at a physical object) or in a particular direction (e.g., when theuser tilts his head to look at his smart watch). The AR device 202 maydisplay a virtual object also based on a geographic location of the ARdevice 202. For example, a set of virtual objects may be accessible whenthe user of the AR device 202 is located in a particular building. Inanother example, virtual objects including sensitive material may beaccessible when the user of the AR device 202 is located within apredefined area associated with the sensitive material and the user isauthenticated. Different levels of content of the virtual objects may beaccessible based on a credential level of the user. For example, a userwho is an executive of a company may have access to more information orcontent in the virtual objects than a manager at the same company. Thesensors 216 may be used to authenticate the user prior to providing theuser with access to the sensitive material (e.g., information displayedas a virtual object such as a virtual dialog box in a see-throughdisplay). Authentication may be achieved via a variety of methods suchas providing a password or an authentication token, or using sensors 216to determine biometric data unique to the user.

Examples of sensors include a camera, an audio sensor, an IMU (InertialMeasurement Unit) sensor, a location sensor, a barometer, a humiditysensor, a light sensor, and a biometric sensor. It is noted that thesensors described herein are for illustration purposes. Sensors 216 arethus not limited to the ones described.

The camera includes an optical sensor(s) (e.g., camera) that mayencompass different spectrums. The camera includes one or more externalcameras aimed outside the AR device 202. For example, the externalcamera includes an infrared camera or a full-spectrum camera. Theexternal camera includes a rear-facing camera and a front-facing cameradisposed in the AR device 202. The front-facing camera may be used tocapture a front field of view of the AR device 202 while the rear-facingcamera may be used to capture a rear field of view of the AR device 202.The pictures captured with the front- and rear-facing cameras may becombined to recreate a 360-degree view of the physical world around theAR device 202.

The camera may also include one or more internal cameras aimed at theuser. The internal camera includes an infrared (IR) camera configured tocapture an image of a retina of the user. The IR camera may be used toperform a retinal scan to map unique patterns of the retina of the user.Blood vessels within the retina absorb light more readily than thesurrounding tissue in the retina and therefore can be identified with IRlighting. The IR camera may cast a beam of IR light into the user's eyeas the user looks through the display (e.g., lenses) towards virtualobjects rendered in the display. The beam of IR light traces a path onthe retina of the user. Because retinal blood vessels absorb more of theIR light than the rest of the eye, the amount of reflection variesduring the retinal scan. The pattern of variations may be used as abiometric data unique to the user.

In another example embodiment, the internal camera includes an ocularcamera configured to capture an image of an iris of the eye of the user102. In response to the amount of light entering the eye, musclesattached to the iris expand or contract the aperture at the center ofthe iris, known as the pupil. The expansion and contraction of the pupildepends on the amount of ambient light. The ocular camera may use irisrecognition as a method for biometric identification. The complexpattern on the iris of the eye of the user is unique and can be used toidentify the user. The ocular camera may cast infrared light to acquireimages of detailed structures of the iris of the eye of the user.Biometric algorithms may be applied to the image of the detailedstructures of the iris to identify the user.

The audio sensor includes a microphone. For example, the microphone isused to record a voice command from the user of the AR device 202. Inother examples, the microphone is used to measure ambient noise level todetermine an intensity of background noise ambient to the AR device 202.In another example, the microphone is used to capture ambient noise.Analytics may be applied to the captured ambient noise to identifyspecific types of noises such as explosions or gunshot noises.

The IMU sensor includes a gyroscope and an inertial motion sensor todetermine an orientation and movement of the AR device 202. For example,the IMU sensor may measure the velocity, orientation, and gravitationalforces on the AR device 202. The IMU sensor may also detect a rate ofacceleration using an accelerometer and changes in angular rotationusing a gyroscope.

The location sensor determines a geolocation of the AR device 202 usinga variety of techniques such as near field communication, GPS,Bluetooth, and Wi-Fi. For example, the location sensor may generategeographic coordinates of the AR device 202.

The barometer measures atmospheric pressure differential to determine analtitude of the AR device 202. For example, the barometer is used todetermine whether the AR device 202 is located on a first floor or asecond floor of a building.

The humidity sensor determines a relative humidity level ambient to theAR device 202. For example, the humidity sensor determines the humiditylevel of a room in which the AR device 202 is located.

The ambient light sensor determines an ambient light intensity aroundthe AR device 202. For example, the ambient light sensor 314 measuresthe ambient light in a room in which the AR device 202 is located.

The biometric sensor includes sensors configured to measure biometricdata unique to the user of the AR device 202. In one example embodiment,the biometric sensors includes an ocular camera, an EEG(electroencephalogram) sensor, and an ECG (electrocardiogram) sensor. Itis noted that the descriptions of biometric sensors disclosed herein arefor illustration purposes. The biometric sensor is thus not limited toany of the ones described.

The EEG sensor includes, for example, electrodes that, when in contactwith the skin of the head of the user, measures electrical activity ofthe brain of the user. The EEG sensor also measures the electricalactivity and wave patterns through different bands of frequency (e.g.,Delta, Theta, Alpha, Beta, Gamma, Mu). EEG signals may be used toauthenticate a user based on fluctuation patterns unique to the user.

The ECG sensor includes, for example, electrodes that measure a heartrate of the user. In particular, the ECG may monitor and measure thecardiac rhythm of the user. A biometric algorithm is applied to the userto identify and authenticate the user. In one example embodiment, theEEG sensor and ECG sensor may be combined into a same set of electrodesto measure both brain electrical activity and heart rate. The set ofelectrodes may be disposed around the helmet so that the set ofelectrodes comes into contact with the skin of the user 102 when theuser wears the AR device 202.

The display 206 includes a display surface or lens capable of displayingAR content (e.g., images, video) generated by the processor 210. Thedisplay 206 may be transparent so that the user can see through thedisplay 206 (e.g., such as in a head-up display).

The storage device 208 stores a library of AR content, AR deviceconfigurations and specifications, AR context collaborationconfigurations. The AR content may include two or three-dimensionalmodels of virtual objects with corresponding audio. In other examples,the AR content may include an AR application that includes interactivefeatures such as displaying additional data (e.g., location ofsprinklers) in response to the user input (e.g., a user says “show methe locations of the sprinklers” while looking at an AR overlay showinglocation of the exit doors). AR applications may have their owndifferent functionalities and operations. Therefore, each AR applicationmay operate distinctly from other AR applications.

The AR device configurations and specifications include informationidentifying the capabilities and capacities of each AR device connectedto the AR device 202. The AR context collaboration configurationincludes information identifying which process, operation, or hardwareto perform, activate, or deactivate on which connected AR device.

The processor 210 includes an AR application 212 and an AR contextcollaboration application 214. The AR application 212 generates adisplay of information related to the physical objects detected by theAR device 202. For example, the AR application 212 generates a displayof a holographic or virtual menu visually perceived as a layer on thephysical objects.

The AR context collaboration application 214 determines a configuration(e.g., capacities, capabilities, context) of the AR device 202 and aconfiguration of AR devices connected to the AR device 202. The ARcontext collaboration application 214 determines which AR device isbetter suited to operate a function or process of the AR application 212based on a comparison of the configurations of the connected AR devices.For example, the AR context collaboration application 214 determinesthat the AR devices 202 are working on a same project. The AR contextcollaboration application 214 optimizes the workflow by breaking downportions of the project that can be performed by users of the connectedAR devices. For example, a user of a connected AR device located at aparticular location with a particular tool is better suited to performtask A than other users of connected AR devices located at otherlocations. In another example, a user with particular credentials orexperience may be better suited to perform a task than other users ofother connected AR devices. In yet another example, the AR contextcollaboration application 214 determines a user of a connected AR deviceis becoming more agitated and nervous based on biometric data. The ARcontext collaboration application 214 determines that another user ofanother connected AR device is calmer and can perform the same task asthe agitated user. The AR context collaboration application 214dynamically reallocates the task from the agitated user to the calmeruser. AR devices are connected when within a predefined proximity to oneanother.

Any one or more of the modules described herein may be implemented usinghardware (e.g., a processor 210 of a machine) or a combination ofhardware and software. For example, any module described herein mayconfigure a processor 210 to perform the operations described herein forthat module. Moreover, any two or more of these modules may be combinedinto a single module, and the functions described herein for a singlemodule may be subdivided among multiple modules. Furthermore, accordingto various example embodiments, modules described herein as beingimplemented within a single machine, database, or device may bedistributed across multiple machines, databases, or devices.

FIG. 3 is a block diagram illustrating an example of a collaborationbetween two connected AR devices. The AR device 102 determines that theAR device 104 is within a predefined distance (e.g., within a samebuilding) of the AR device 102. Once detected that the AR devices are inproximity to one another, the AR context collaboration application 302of the AR device 102 communicates and exchanges configuration andcontext information with the AR context collaboration application 304 ofthe AR device 104.

FIG. 4 is a block diagram illustrating an example embodiment of an ARcontext collaboration application 402. The AR context collaborationapplication 402 includes a current device configuration module 404, aconnected device configuration module 406, and a collaboration module408. The current device configuration module 404 determines andidentifies configuration settings of the current AR device includingcapabilities of the current AR device (e.g., display has 1080presolution, infrared sensor), capacities of the current AR device (e.g.,processor is running at 10% capacity, RAM usage is 40%), and context ofthe current AR device (e.g., user-based context, ambient-based context).Similar to the current device configuration module 404, the connecteddevice configuration module 406 determines and identifies configurationsettings of the connected AR device including capabilities of theconnected AR device (e.g., display has 720p resolution, infraredsensor), capacities of the connected AR device (e.g., processor isrunning at 60% capacity, RAM usage is 80%), and context of the connectedAR device (e.g., user-based context, ambient-based context).

The collaboration module 408 retrieves the configuration settings of thecurrent AR device from the current device configuration module 404 andthe configuration settings of the connected AR device configurationmodule 406. The collaboration module 408 determines which AR device isbetter suited to perform an operation or a process based on theconfiguration settings of both the current and connected AR devices. Forexample, the collaboration module 408 compares the hardwarespecifications, software specification, capabilities and capacities, andcontext of the connected AR devices to determine which AR device isbetter capable or more efficient to perform an operation.

FIG. 5 is a block diagram illustrating an example embodiment of thecurrent device configuration module 404 of FIG. 4. The current deviceconfiguration module 404 identifies a hardware configuration 502, asoftware configuration 504, a user context 506, and an ambient context508. The hardware configuration 502 identifies technical specifications(e.g., processor model x, camera model y, display model z withresolution z′) related to the hardware of the current AR device. Thesoftware configuration 502 identifies technical specifications relatedto the software (e.g., AR Operating System version x) operating in thecurrent AR device. The user context 506 includes user profile,credential, authentication, biometric data, and assigned AR task. Theambient context 508 includes ambient-based sensor data such as location,temperature, and AR task being performed.

FIG. 6 is a block diagram illustrating an example embodiment of aconnected device configuration module 406 of FIG. 4. The connecteddevice configuration module 406 includes a profile extraction module 604that communicates with the AR application of a connected AR device toretrieve configuration settings of the connected AR device. For example,the current AR device authenticates with the connected AR device inresponse to detecting that both are located within a same physicalenvironment. The current AR device then queries the connected AR devicefor the configuration settings of the connected AR device.

FIG. 7 is a block diagram illustrating an example embodiment of thecollaboration module 408 of FIG. 4. The collaboration module 408includes a configuration generator 702 that generates a current devicecollaboration configuration 704 and a connected device collaborationconfiguration 706 based on a comparison of the configuration settingsfrom both the current AR device and the connected AR device. Thecollaboration module 408 identifies which AR device is better capable ormore efficient to perform an operation of either connected AR devices.For example, the collaboration module 408 determines when the display ofa car has a better resolution than smart glasses. The collaborationmodule 408 provides the current device collaboration configuration 704to the smart glasses to direct the smart glasses to go into hibernationmode. The current device collaboration configuration 704 modifies anoperation of the AR application in the smart glasses. The collaborationmodule 408 provides the connected device collaboration configuration 706to the car to seamlessly take over a display of AR content from thesmart glasses. The connected device collaboration configuration 706modifies an operation of the AR application in the car.

FIG. 8 is an interaction diagram illustrating interactions between twoAR devices, according to an example embodiment. The AR device 102determines an AR device A configuration and context at operation 802. Atoperation 804, the AR device 102 sends a query for aconfiguration/context of the AR device B 104. The AR device 104determines an AR device B configuration and context at operation 808. Atoperation 806, the AR device 104 sends the AR device B configuration andcontext to the AR device A 102. At operation 810, the AR device A 102generates AR device A collaboration configuration. At operation 812, theAR device A 102 generates AR device B collaboration configuration. Atoperation 814, the AR device A 102 sends the AR device B collaborationconfiguration to the AR device B 104. At operation 816, the operation ofthe AR device A 102 is modified based on the AR device A collaborationconfiguration. At operation 818, the operation of the AR device B 104 ismodified based on the AR device B collaboration configuration receivedat operation 814.

FIG. 9 is a flow diagram illustrating a method 900 for contextualcollaboration between augmented reality devices. At operation 902, an ARdevice determines its configuration and context. In one exampleembodiment, operation 902 can be implemented with the current deviceconfiguration module 404. At operation 904, the AR device determines aconnected AR device configuration and context. In one exampleembodiment, operation 904 can be implemented with the connected deviceconfiguration module 406. At operation 906, the AR device generates acurrent device collaboration configuration. In one example embodiment,operation 906 can be implemented with the collaboration module 408. Atoperation 908, the AR device generates a connected device collaborationconfiguration. In one example embodiment, operation 908 can beimplemented with the collaboration module 408. At operation 910, the ARdevice modifies its functionality and operation based on the currentdevice collaboration configuration. At operation 912, the connected ARdevice modifies its functionality and operation based on the connecteddevice collaboration configuration.

FIG. 10 is a flow diagram illustrating a method for generatingcollaboration configurations for connected augmented reality devices. Atoperation 1002, the collaboration module 408 allocates processing tasks,display tasks, and sensor tasks based on the current AR deviceconfiguration and context, and the connected AR device configuration andcontext. At operation 1004, the collaboration module 408 generates acurrent AR device collaboration configuration based on the allocatedtasks for the current AR device. At operation 1006, the collaborationmodule 408 generates a connected AR device collaboration configurationbased on the allocated tasks for the connected AR device.

Modules, Components and Logic

Certain embodiments are described herein as including logic or a numberof components, modules, or mechanisms. Modules may constitute eithersoftware modules (e.g., code embodied on a machine-readable medium or ina transmission signal) or hardware modules. A hardware module is atangible unit capable of performing certain operations and may beconfigured or arranged in a certain manner. In example embodiments, oneor more computer systems (e.g., a standalone, client, or server computersystem) or one or more hardware modules of a computer system (e.g., aprocessor 210 or a group of processors 210) may be configured bysoftware (e.g., an application or application portion) as a hardwaremodule that operates to perform certain operations as described herein.

In various embodiments, a hardware module may be implementedmechanically or electronically. For example, a hardware module maycomprise dedicated circuitry or logic that is permanently configured(e.g., as a special-purpose processor, such as a field programmable gatearray (FPGA) or an application-specific integrated circuit (ASIC)) toperform certain operations. A hardware module may also compriseprogrammable logic or circuitry (e.g., as encompassed within ageneral-purpose processor 210 or other programmable processor 210) thatis temporarily configured by software to perform certain operations. Itwill be appreciated that the decision to implement a hardware modulemechanically, in dedicated and permanently configured circuitry, or intemporarily configured circuitry (e.g., configured by software) may bedriven by cost and time considerations.

Accordingly, the term “hardware module” should be understood toencompass a tangible entity, be that an entity that is physicallyconstructed, permanently configured (e.g., hardwired) or temporarilyconfigured (e.g., programmed) to operate in a certain manner and/or toperform certain operations described herein. Considering embodiments inwhich hardware modules are temporarily configured (e.g., programmed),each of the hardware modules need not be configured or instantiated atany one instance in time. For example, where the hardware modulescomprise a general-purpose processor 210 configured using software, thegeneral-purpose processor 210 may be configured as respective differenthardware modules at different times. Software may accordingly configurea processor 210, for example, to constitute a particular hardware moduleat one instance of time and to constitute a different hardware module ata different instance of time.

Hardware modules can provide information to, and receive informationfrom, other hardware modules. Accordingly, the described hardwaremodules may be regarded as being communicatively coupled. Where multipleof such hardware modules exist contemporaneously, communications may beachieved through signal transmission (e.g., over appropriate circuitsand buses that connect the hardware modules). In embodiments in whichmultiple hardware modules are configured or instantiated at differenttimes, communications between such hardware modules may be achieved, forexample, through the storage and retrieval of information in memorystructures to which the multiple hardware modules have access. Forexample, one hardware module may perform an operation and store theoutput of that operation in a memory device to which it iscommunicatively coupled. A further hardware module may then, at a latertime, access the memory device to retrieve and process the storedoutput. Hardware modules may also initiate communications with input oroutput devices and can operate on a resource (e.g., a collection ofinformation).

The various operations of example methods described herein may beperformed, at least partially, by one or more processors 210 that aretemporarily configured (e.g., by software) or permanently configured toperform the relevant operations. Whether temporarily or permanentlyconfigured, such processors 210 may constitute processor-implementedmodules that operate to perform one or more operations or functions. Themodules referred to herein may, in some example embodiments, compriseprocessor-implemented modules.

Similarly, the methods described herein may be at least partiallyprocessor-implemented. For example, at least some of the operations of amethod may be performed by one or more processors 210 orprocessor-implemented modules. The performance of certain operations maybe distributed among the one or more processors 210, not only residingwithin a single machine, but deployed across a number of machines. Insome example embodiments, the processor or processors 210 may be locatedin a single location (e.g., within a home environment, an officeenvironment or as a server farm), while in other embodiments theprocessors 210 may be distributed across a number of locations.

The one or more processors 210 may also operate to support performanceof the relevant operations in a “cloud computing” environment or as a“software as a service” (SaaS). For example, at least some of theoperations may be performed by a group of computers (as examples ofmachines including processors 210), these operations being accessiblevia a network 108 and via one or more appropriate interfaces (e.g.,APIs).

Electronic Apparatus and System

Example embodiments may be implemented in digital electronic circuitry,or in computer hardware, firmware, software, or in combinations of them.Example embodiments may be implemented using a computer program product,e.g., a computer program tangibly embodied in an information carrier,e.g., in a machine-readable medium for execution by, or to control theoperation of, data processing apparatus, e.g., a programmable processor210, a computer, or multiple computers.

A computer program can be written in any form of programming language,including compiled or interpreted languages, and it can be deployed inany form, including as a stand-alone program or as a module, subroutine,or other unit suitable for use in a computing environment. A computerprogram can be deployed to be executed on one computer or on multiplecomputers at one site or distributed across multiple sites andinterconnected by a communication network 108.

In example embodiments, operations may be performed by one or moreprogrammable processors 210 executing a computer program to performfunctions by operating on input data and generating output. Methodoperations can also be performed by, and apparatus of exampleembodiments may be implemented as, special purpose logic circuitry(e.g., a FPGA or an ASIC).

A computing system can include clients and servers 110. A client andserver 110 are generally remote from each other and typically interactthrough a communication network 108. The relationship of client andserver 110 arises by virtue of computer programs running on therespective computers and having a client-server relationship to eachother. In embodiments deploying a programmable computing system, it willbe appreciated that both hardware and software architectures meritconsideration. Specifically, it will be appreciated that the choice ofwhether to implement certain functionality in permanently configuredhardware (e.g., an ASIC), in temporarily configured hardware (e.g., acombination of software and a programmable processor 210), or acombination of permanently and temporarily configured hardware may be adesign choice. Below are set out hardware (e.g., machine) and softwarearchitectures that may be deployed, in various example embodiments.

Example Machine Architecture

FIG. 11 is a block diagram of a machine in the example form of acomputer system 1100 within which instructions 1106 for causing themachine to perform any one or more of the methodologies discussed hereinmay be executed. In alternative embodiments, the machine operates as astandalone device or may be connected (e.g., networked) to othermachines. In a networked deployment, the machine may operate in thecapacity of a server 110 or a client machine in a server-client networkenvironment, or as a peer machine in a peer-to-peer (or distributed)network environment. The machine may be a personal computer (PC), atablet PC, a set-top box (STB), a personal digital assistant (PDA), acellular telephone, a web appliance, a network router, switch or bridge,or any machine capable of executing instructions 1106 (sequential orotherwise) that specify actions to be taken by that machine. Further,while only a single machine is illustrated, the term “machine” shallalso be taken to include any collection of machines that individually orjointly execute a set (or multiple sets) of instructions 1106 to performany one or more of the methodologies discussed herein.

The example computer system 1100 includes a processor 1104 (e.g., acentral processing unit (CPU), a graphics processing unit (GPU) orboth), a main memory 1110 and a static memory 1122, which communicatewith each other via a bus 1112. The computer system 1100 may furtherinclude a video display unit 1108 (e.g., a liquid crystal display (LCD)or a cathode ray tube (CRT)). The computer system 1100 also includes analphanumeric input device 1114 (e.g., a keyboard), a user interface (UI)navigation (or cursor control) device 1116 (e.g., a mouse), a disk driveunit 1102, a signal generation device 1120 (e.g., a speaker) and anetwork interface device 1124.

Machine-Readable Medium

The disk drive unit 1102 includes a computer-readable medium 1118 onwhich is stored one or more sets of data structures and instructions1106 (e.g., software) embodying or utilized by any one or more of themethodologies or functions described herein. The instructions 1106 mayalso reside, completely or at least partially, within the main memory1110 and/or within the processor 1104 during execution thereof by thecomputer system 1100, the main memory 1110 and the processor 1104 alsoconstituting machine-readable media 1118. The instructions 1106 may alsoreside, completely or at least partially, within the static memory 1122.

While the machine-readable medium 1118 is shown in an example embodimentto be a single medium, the term “machine-readable medium” may include asingle medium or multiple media (e.g., a centralized or distributeddatabase, and/or associated caches and servers 110) that store the oneor more instructions 1106 or data structures. The term “machine-readablemedium” shall also be taken to include any tangible medium that iscapable of storing, encoding, or carrying instructions 1106 forexecution by the machine and that causes the machine to perform any oneor more of the methodologies of the present embodiments, or that iscapable of storing, encoding, or carrying data structures utilized by orassociated with such instructions 1106. The term “machine-readablemedium” shall accordingly be taken to include, but not be limited to,solid-state memories, and optical and magnetic media. Specific examplesof machine-readable media 1118 include non-volatile memory, including byway of example semiconductor memory devices (e.g., erasable programmableread-only memory (EPROM), electrically erasable programmable read-onlymemory (EEPROM), and flash memory devices); magnetic disks such asinternal hard disks and removable disks; magneto-optical disks; andcompact disc-read-only memory (CD-ROM) and digital versatile disc (ordigital video disc) read-only memory (DVD-ROM) disks.

Transmission Medium

The instructions 1106 may further be transmitted or received over acommunications network 1126 using a transmission medium. Theinstructions 1106 may be transmitted using the network interface device1124 and any one of a number of well-known transfer protocols (e.g.,HTTP). Examples of communication networks 1126 include a LAN, a WAN, theInternet, mobile telephone networks, POTS networks, and wireless datanetworks (e.g., WiFi and WiMax networks). The term “transmission medium”shall be taken to include any intangible medium capable of storing,encoding, or carrying instructions 1106 for execution by the machine,and includes digital or analog communications signals or otherintangible media to facilitate communication of such software.

Although an embodiment has been described with reference to specificexample embodiments, it will be evident that various modifications andchanges may be made to these embodiments without departing from thescope of the present disclosure. Accordingly, the specification anddrawings are to be regarded in an illustrative rather than a restrictivesense. The accompanying drawings that form a part hereof, show by way ofillustration, and not of limitation, specific embodiments in which thesubject matter may be practiced. The embodiments illustrated aredescribed in sufficient detail to enable those skilled in the art topractice the teachings disclosed herein. Other embodiments may beutilized and derived therefrom, such that structural and logicalsubstitutions and changes may be made without departing from the scopeof this disclosure. This Detailed Description, therefore, is not to betaken in a limiting sense, and the scope of various embodiments isdefined only by the appended claims, along with the full range ofequivalents to which such claims are entitled.

Such embodiments of the inventive subject matter may be referred toherein, individually and/or collectively, by the term “invention” merelyfor convenience and without intending to voluntarily limit the scope ofthis application to any single invention or inventive concept if morethan one is in fact disclosed. Thus, although specific embodiments havebeen illustrated and described herein, it should be appreciated that anyarrangement calculated to achieve the same purpose may be substitutedfor the specific embodiments shown. This disclosure is intended to coverany and all adaptations or variations of various embodiments.Combinations of the above embodiments, and other embodiments notspecifically described herein, will be apparent to those of skill in theart upon reviewing the above description.

The Abstract of the Disclosure is provided to allow the reader toquickly ascertain the nature of the technical disclosure. It issubmitted with the understanding that it will not be used to interpretor limit the scope or meaning of the claims. In addition, in theforegoing Detailed Description, it can be seen that various features aregrouped together in a single embodiment for the purpose of streamliningthe disclosure. This method of disclosure is not to be interpreted asreflecting an intention that the claimed embodiments require morefeatures than are expressly recited in each claim. Rather, as thefollowing claims reflect, inventive subject matter lies in less than allfeatures of a single disclosed embodiment. Thus the following claims arehereby incorporated into the Detailed Description, with each claimstanding on its own as a separate embodiment.

The following enumerated embodiments describe various exampleembodiments of methods, machine-readable media, and systems (e.g.,machines, devices, or other apparatus) discussed herein.

A first embodiment provides a first display device (e.g., a first ARdevice) comprising:

-   one or more hardware processors; and-   a memory storing instructions that, when executed by the one or more    hardware processors, configure the first display device to perform    operations comprising:-   determining a first configuration of the first display device and a    first context of a first AR application operating on the first    display device;-   connecting to a second display device;-   determining a second configuration of the second display device and    a second context of a second AR application operating on the second    display device;-   generating a first collaboration configuration for the first display    device and a second collaboration configuration for the second    display device, the first and second collaborations based on the    first configuration, the first context, the second configuration,    and the second context, the second display device configured to    modify an operation of the second AR application based on the second    collaboration configuration; and-   modifying an operation of the first AR application in the first    display device based on the first collaboration configuration.

A second embodiment provides a device according to the first embodiment,wherein the operations further comprises:

-   identifying a common process between the first and second display    devices based on a common operation identified in the first and    second configurations and in the first and second contexts;-   determining that the first display device is configured to perform    the common process more efficiently than the second display device;-   assigning the common process to the first display device in the    first collaboration configuration; and-   removing the common process from the second display device in the    second collaboration configuration.

A third embodiment provides a device according to the first embodiment,wherein modifying the operation of the first AR application in the firstdisplay device further comprises:

-   disabling a first display of the first display device; and-   causing a second display of the second display device to display    content from the first AR application using the second collaboration    configuration on the second AR application of the second display    device.

A fourth embodiment provides a device according to the first embodiment,wherein the operations further comprises:

-   identifying that a first task of a first user of the first display    device and a second task of a second user of the second display    device are part of a general workflow;-   generating a first content and a first user interface for the first    user of the first display device based on the first task, the first    collaboration configuration including the first content and the    first user interface; and-   generating a second content and a second user interface for the    second user of the first display device based on the second task,    the second collaboration configuration including the second content    and the second user interface.

A fifth embodiment provides a device according to the first embodiment,wherein the first configuration includes hardware and softwarespecifications of the first display device, and hardware and softwareresource capacities and availabilities.

A sixth embodiment provides a device according to the first embodiment,wherein the first context includes user-based context and ambient-basedcontext of the display device,

-   the user-based context based on a user profile of a first user of    the first display device, a user credential of the first user,    biometric data related to the first user, the biometric data    including at least one of a heart rate, a blood pressure, or brain    activity,-   the ambient-based context including geographic location of the    display device, an orientation and position of the first display    device, an ambient pressure, an ambient humidity level, or an    ambient light level.

A seventh embodiment provides a device according to the firstembodiment, wherein the first collaboration configuration includesallocation instructions of operations and tasks from the first ARapplication and the second AR application between the first displaydevice and the second display device.

An eight embodiment provides a device according to the first embodiment,further comprising:

a display; and

a plurality of sensors including a first set of sensors configured tomeasure first sensor data related to a user of the HMD, and a second setof sensors configured to measure second sensor data related to the HMD,

wherein the operations further comprises:

determining a user-based context based on the first set of sensors,determining an ambient-based context based on the second set of sensors,and

generating AR content based on the user-based context and theambient-based context, the first AR application being configured todisplay the AR content in the display.

A ninth embodiment provides a device according to the first embodiment,wherein the operations further comprises:

-   modifying the AR content based on the first collaboration    configuration; and-   causing a display of the modified AR content in the display of the    first display device.

A tenth embodiment provides a device according to the first embodiment,wherein the operations further comprises:

-   determining a first authorization level of the first user based on    the user-based context and the ambient-based context; and-   determining a second authorization level of a second user of the    second display device based on a user-based context of the second    user and an ambient-based context of the second display device,-   wherein the first and second collaboration configurations are based    on the first authorization level of the first user and the second    authorization level of the second user.

What is claimed is:
 1. A first display device comprising: one or morehardware processors; and a memory storing instructions that, whenexecuted by the one or more hardware processors, configure the firstdisplay device to perform operations comprising: determining a firstdevice configuration of the first display device and a first context ofa first AR application operating on the first display device; connectingto a second display device; determining a second device configuration ofthe second display device and a second context of a second ARapplication operating on the second display device; generating a firstcollaboration configuration for the first display device and a secondcollaboration configuration for the second display device, the first andsecond collaboration configurations being generated based on the firstdevice configuration, the first context, the second deviceconfiguration, and the second context, the second display device beingconfigured to modify an operation of the second AR application based onthe second collaboration configuration; and modifying an operation ofthe first AR application in the first display device based on the firstcollaboration configuration.
 2. The display device of claim 1, whereinthe operations further comprise: identifying a common process executedby the first and second display devices based on a common operationidentified in the first and second configurations and in the first andsecond contexts; determining that the first display device is configuredto perform the common process more efficiently than the second displaydevice; assigning the common process to the first display device in thefirst collaboration configuration; and removing the common process fromthe second display device in the second collaboration configuration. 3.The display device of claim 1, wherein the modifying of the operation ofthe first AR application in the first display device comprises:disabling a first display of the first display device; and causing asecond display of the second display device to display content from thefirst AR application using the second collaboration configuration on thesecond AR application of the second display device.
 4. The displaydevice of claim 1, wherein the operations further comprise: determiningthat a first task of a first user of the first display device and asecond task of a second user of the second display device are part of ageneral workflow; generating first content and a first user interfacefor the first user of the first display device based on the first task,the first collaboration configuration including the first content andthe first user interface; and generating a second content and a seconduser interface for the second user of the first display device based onthe second task, the second collaboration configuration including thesecond content and the second user interface.
 5. The display device ofclaim 1, wherein the first configuration includes hardware and softwarespecifications of the first display device, and hardware and softwareresource capacities and availabilities.
 6. The display device of claim1, wherein the first context includes a user-based context and anambient-based context of the display device, the user-based contextbeing generated based on a user profile of a first user of the firstdisplay device, a user credential of the first user, and biometric datafrom the first user, the biometric data including at least one of aheart rate, a blood pressure, or brain activity, the ambient-basedcontext indicating at least one of a geographic location of the displaydevice, an orientation and a position of the first display device, anambient pressure, an ambient humidity level, or an ambient light level.7. The display device of claim 1, wherein the first collaborationconfiguration includes allocation instructions of operations and tasksfrom the first AR application and the second AR application between thefirst display device and the second display device.
 8. The displaydevice of claim 1, further comprising: a display; and a plurality ofsensors including a first set of sensors configured to measure firstsensor data related to a user of the HMD, and a second set of sensorsconfigured to measure second sensor data related to the HMD, wherein theoperations further comprise: determining a third context including auser-based context based on the first set of sensors, determining afourth context including an ambient-based context based on the secondset of sensors, and generating AR content based on the third context andthe fourth context, the first AR application being configured to displaythe AR content in the display.
 9. The display device of claim 8, whereinthe operations further comprises: modifying the AR content based on thefirst collaboration configuration; and causing a display of the modifiedAR content in the display of the first display device.
 10. The displaydevice of claim 8, wherein the operations further comprise: determininga first authorization level of the first user based on the third contextand the fourth context; and determining a second authorization level ofa second user of the second display device based on a fifth contextincluding a user-based context of the second user and a sixth contextincluding an ambient-based context of the second display device, whereinthe first and second collaboration configurations are based on the firstauthorization level of the first user and the second authorization levelof the second user.
 11. A method comprising: determining a first deviceconfiguration of a first display device and a first context of a firstAR application operating on the first display device; connecting to asecond display device; determining a second device configuration of thesecond display device and a second context of a second AR applicationoperating on the second display device; generating a first collaborationconfiguration for the first display device and a second collaborationconfiguration for the second display device, the first and secondcollaboration configurations being generated based on the first deviceconfiguration, the first context, the second device configuration, andthe second context, the second display device being configured to modifyan operation of the second AR application based on the secondcollaboration configuration; and modifying an operation of the first ARapplication in the first display device based on the first collaborationconfiguration.
 12. The method of claim 11, further comprising:identifying a common process executed by the first and second displaydevices based on a common operation identified in the first and secondconfigurations and in the first and second contexts; determining thatthe first display device is configured to perform the common processmore efficiently than the second display device; assigning the commonprocess to the first display device in the first collaborationconfiguration; and removing the common process from the second displaydevice in the second collaboration configuration.
 13. The method ofclaim 11, wherein the modifying of the operation of the first ARapplication in the first display device comprises: disabling a firstdisplay of the first display device; and causing a second display of thesecond display device to display content from the first AR applicationusing the second collaboration configuration on the second ARapplication of the second display device.
 14. The method of claim 11,further comprising: determining that a first task of a first user of thefirst display device and a second task of a second user of the seconddisplay device are part of a general workflow; generating first contentand a first user interface for the first user of the first displaydevice based on the first task, the first collaboration configurationincluding the first content and the first user interface; and generatinga second content and a second user interface for the second user of thefirst display device based on the second task, the second collaborationconfiguration including the second content and the second userinterface.
 15. The method of claim 11, wherein the first configurationincludes hardware and software specifications of the first displaydevice, and hardware and software resource capacities andavailabilities.
 16. The method of claim 11, wherein the first contextincludes user-based context and ambient-based context of the firstdisplay device, the user-based context being generated based on a userprofile of a first user of the first display device, a user credentialof the first user, and biometric data from the first user, the biometricdata including at least one of a heart rate, a blood pressure, or brainactivity, the ambient-based context indicating at least one of ageographic location of the display device, an orientation and a positionof the first display device, an ambient pressure, an ambient humiditylevel, or an ambient light level.
 17. The method of claim 11, whereinthe first collaboration configuration includes allocation instructionsof operations and tasks from the first AR application and the second ARapplication between the first display device and the second displaydevice.
 18. The method of claim 11, wherein the first display devicecomprises a display, and a plurality of sensors including a first set ofsensors configured to measure first sensor data related to a user of theHMD, and a second set of sensors configured to measure second sensordata related to the HMD, wherein the method further comprises:determining a third context including a user-based context based on thefirst set of sensors, determining a fourth context including anambient-based context based on the second set of sensors, generating ARcontent based on the third context and the fourth context, the first ARapplication being configured to display the AR content in the display,modifying the AR content based on the first collaboration configuration;and causing a display of the modified AR content in the display of thefirst display device.
 19. The method of claim 18, further comprising:determining a first authorization level of the first user based on thethird context and the fourth context; and determining a secondauthorization level of a second user of the second display device basedon a fifth context including a user-based context of the second user anda sixth context including an ambient-based context of the second displaydevice, wherein the first and second collaboration configurations arebased on the first authorization level of the first user and the secondauthorization level of the second user.
 20. A non-transitorymachine-readable medium comprising instructions that, when executed byone or more processors of a machine, cause the machine to performoperations comprising: determining a first device configuration of afirst display device and a first context of a first AR applicationoperating on the first display device; connecting to a second displaydevice; determining a second device configuration of the second displaydevice and a second context of a second AR application operating on thesecond display device; generating a first collaboration configurationfor the first display device and a second collaboration configurationfor the second display device, the first and second collaborationconfigurations being generated based on the first device configuration,the first context, the second device configuration, and the secondcontext, the second display device being configured to modify anoperation of the second AR application based on the second collaborationconfiguration; and modifying an operation of the first AR application inthe first display device based on the first collaboration configuration.